Skip to content

Conversation

@OussamaSaoudi
Copy link
Collaborator

@OussamaSaoudi OussamaSaoudi commented Oct 14, 2025

Which Delta project/connector is this regarding?

  • Spark
  • Standalone
  • Flink
  • Kernel
  • Other (fill in here)

Description

This introduces the snapshot construction spec and workload runner. These are used to measure the time it takes to construct a snapshot and perform protocol & metadata phase.

The snapshot construction spec takes an optional version.

How was this patch tested?

Does this PR introduce any user-facing changes?

if (workloadSpec.getVersion() != null) {
builder.atVersion(workloadSpec.getVersion());
}
return builder.build(engine);
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should you call snapshot.getVersion, or cast it to SnapshotImpl and then call .getMetadata or .getProtocol? and maybe even print it out as a simple validation? or is that out of scope?

Copy link
Collaborator Author

@OussamaSaoudi OussamaSaoudi Oct 27, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Given this is part of the inner loop of the benchmark, I want to avoid any logging. Moreover, due to repeat runs, logging this can actually get quite noisy

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think one area where this type of logging can be introduced is in the executeAsTest when that eventually comes in.

Copy link
Collaborator

@scottsand-db scottsand-db left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM -- Asked a question about some tiny validation. I defer to you. And clean up as needed. Thanks!

@OussamaSaoudi OussamaSaoudi marked this pull request as ready for review October 27, 2025 16:37
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants